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ABSTRACT 



A project was conducted by the National Automotive 
Technicians Education Foundation to review and update the standards for 
automobile, collision repair and refinishing, and medium and heavy truck 
technician training programs. The standards include a task list, tools and 
equipment requirements, program hour requirements, instructor qualifications, 
and program standards. The review process included committees and workshops 
with participants from the following groups: vehicle manufacturers, trade 
association members, independent and dealership technicians and owners, 
automotive instructors, educational administrators, government, consumer 
groups, and equipment suppliers, and other industry partners. Other project 
activities were as follows: identifying the reading, writing, mathematics, 
and science skills associated with the technical tasks identified in the 
program standards updates in order to create a certificate of basic 
competencies; training evaluation team leaders; promoting the standards 
throughout the United States; and assisting schools in initiating 
self-evaluation of their automotive repair and auto body repair technicians. 
Formative evaluation was conducted throughout the project. A summative 
evaluation, conducted by the Center on Education and Training for Employment 
at the Ohio State University, concluded that the updated standards and 
certification requirements improve the learning that takes place in an 
automotive repair program. (KC) 
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FINAL REPORT OF GRANT ACTIVITIES FOR U.S. DEPT. OF EDUCATION 
BUSINESS AND EDUCATION STANDARDS PROGRAM 



National Automotive Technicians Education Foundation (NATEF) 
Grant Number V244A20010 



SECTION ONE: ACCOMPLISHMENTS AND OBJECTIVES 

The National Automotive Technicians Education Foundation (NATEF) had a nine year 
history of standards development for automotive technician training programs when it 
applied for funding under the Business and Education Standards Program. NATEF is a 
501 (c) (3) organization, separate from, but associated with, the National Institute for 
Automotive Service Excellence (ASE). NATEF ’s primary purpose is to evaluate training 
programs against standards, identified by the automotive industry, for certification by 
ASE. NATEF began with standards for automobile technician training, added autobody 
(now called collision repair & refmish) in 1989, and medium/heavy truck in 1992. 

Although the standards were endorsed by the automotive industry and education alike, 
NATEF recognized that they must be regularly reviewed and updated to have value. 
Therefore, the first objective stated in the grant application was to update the standards 
for automobile, collision repair & refinish, and medium/heavy truck technician training 
programs. The second objective designated in the application was to identify the reading, 
writing, mathematics, and science skills associated with the technical tasks identified in 
each of the three automotive areas. These applied academic skills would be the source for 
a certificate of basic competencies. Other stated objectives included: training Evaluation 
Team Leaders (ETLs), promoting the standards in states, and assisting schools in 
initiating the self-study (self-evaluation). All of the objectives were accomplished. Each 
of the objectives will be discussed in detail in this report. 

Objective One - Update Standards 

As previously noted, the first objective dealt with the update of the standards for each 
automotive (automobile, collision repair & refmish, and medium/heavy truck) area. The 
standards include: task list, tools and equipment, program hour requirements, instructor 
qualifications, and program standards. The process used for updating was repeated for 
each program area. 

The process drew upon participation of individuals from the well-developed partnerships 
forged by ASE, since its inception in 1972, and subsequently followed by NATEF. 
Namely, vehicle manufacturers, trade association members, independent and dealership 
tec hni ci ans and owners, automotive instructors, educational administrators, government, 
consumer groups, and equipment suppliers are examples of industry partners. Hence, 
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committees of individuals who represent a broad spectrum of the automotive industry 
participated in the update workshops. 

The collision repair & refinish standards were reviewed on February 2-4, 1993 in 
Herndon, Virginia. The project director and ASE technical staff co-facilitated the 
workshop. The task list, which served as the foundation, was reviewed first. In addition to 
the NATEF task list, participants referenced the most current ASE task list, used for the 
development of the ASE technician certification tests. Priority ratings were established 
for each task. The tool and equipment list, including hand tools, general shop tools and 
equipment, and specialty tools and equipment, was then determined. Hour requirements 
for each area within collision repair & refinish (structural analysis & damage repair, non- 
structural analysis & damage repair, mechanical & electrical components, plastics & 
adhesives, and painting and refinishing) were set. Instructor qualifications and program 
standards were reviewed and modified. 

Upon the conclusion of the workshop, the NATEF staff incorporated all the changes into 
a document that was mailed to all participants for their review for accuracy. Once it was 
determined to be accurate, the document was submitted to the NATEF Board of Trustees 
and the ASE Board of Directors for their review and approval. Approval was granted at 
the November 1 993 board meetings. A phase-in period was established for programs 
already in the process of program certification. 

Once the standards were approved by the NATEF and ASE boards, the Evaluation Team 
Leader manual, program certification manual, and team member booklets were changed 
accordingly. 

The automobile program standards were reviewed and updated on June 8-10, 1993 in 
Herndon, Virginia. The eight automobile areas for program certification include: Engine 
Performance, Electrical/Electronic Systems, Brakes, Suspension & Steering, Automatic 
Transmission/Transaxles, Manual Drive Train & Axles, Heating & Air Conditioning, and 
Engine Repair. The process was identical to that previously discussed for collision repair 
& refinish. The changes were approved at the November 1993 meetings of the NATEF 
and ASE boards. 

Lastly, the medium/heavy truck standards were reviewed and updated on December 7-9, 
1993. The following eight areas are included in medium/heavy truck: Gasoline Engines, 
Diesel Engines, Electrical/Electronic Systems, Drive Train, Suspension & Steering, 
Brakes, Preventive Maintenance Inspection, and Heating & Air Conditioning. The 
process identified above was used. The NATEF and ASE boards approved the changes at 
their respective meetings in March and May of 1994. 

It is significant to note that NATEF updated the automobile standards in March of 
1996 and the collision repair & refinish standards in September of 1996 without the 
use of grant funds . The medium/heavy truck standards will be updated in August of 
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1997. This demonstrates the commitment to the standards by both the NATEF and 
ASE boards and the value of standards to the automotive industry and to schools. 

Objective Two - Applied Academics 

The second objective as stated in the application involved the identification of the applied 
academic skills of reading, writing, mathematics, and science that would be the basis for 
a certificate of basic competencies. Since this was a new responsibility for NATEF, the 
project director spent time researching methodologies that could be employed. V-TECS 
was awarded the contract and the research design was mutually established. 

The Basic/Essential Skills Taxonomy, developed by Dr. Les Snyder at Arizona State 
University, was used for the coding system of the language arts, mathematics, and science 
skills. The NATEF task list provided the technical skills required for entry into 
automobile, collision repair & refinish, and medium/heavy truck technician careers. The 
entire project was a collaborative effort. 

V-TECS identified subject matter experts in each of the related academic fields and 
NATEF identified ASE certified technicians as the technical experts. Workshops were 
convened at different locations around the country for each automotive area. The same 
academic experts were used in each of the workshops whereas the technical experts 
changed with each location. 

The workshops began with an explanation of the project and the process that would be 
used. The academic experts each carefully defined the taxonomy codes in common 
language and provided examples of how the codes could be applied in daily life. Once the 
codes were defined, the groups turned the focus to their application to automotive tasks. 

The academic experts systematically led the participants through the NATEF task list by 
examining each of the automobile tasks in terms of the academic skills required to 
perform the task. For example, each task in the Engine Performance category would first 
be examined for the related science skills. Once every science skill had been identified, 
the groups would look at each task in terms of the mathematics skills required. The 
process was followed a third time to identify the language arts skills. 

After the academic skills lists were completed, workshop participants were asked to 
identify the workplace skills required on the job. The participants were given the 
V-TECS/ Illinois Workplace Skills List and asked to rate each item for importance to 
their specific occupation. Any item that was rated as important by a majority of 
participants was included in the published results. 

The applied academic skills workshops for automobile technicians were accomplished in 
a series of four workshops held in Atlanta, Georgia; Boston, Massachusetts; Cincinnati, 
Ohio; and Phoenix, Arizona. The collision repair & refinish workshops were conducted in 
Fort Lauderdale, Florida and Pittsburgh, Pennsylvania. The following four cities hosted 
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the medium/heaw truck applied academic workshops: Bessemer, Alabama; Melrose 
Park, Illinois; Beaverton, Oregon; and Clayton, Ohio. 

NATEF published the results of the research in three books: The Applied Academics and 
Workplace Skills For Automobile Technicians, The Applied Academics and Workplace 
Skills For Collision Repair & Refinish Technicians, and The Applied Academics and 
Workplace Skills For Truck Technicians. 

Objective Three - Evaluation Team Leader Training 

The role of the Evaluation Team Leader (ETL) is critical to ASE certification of 
automotive training programs. ETLs are instructors who are ASE certified master 
technicians in their field, have both teaching and technician job experience, and have 
been trained by NATEF to lead the on-site evaluation of programs going through the 
certification process. The ETLs must be knowledgeable about the ASE certification 
program policies and procedures and be willing to lead a group of technicians through the 
on-site evaluation. ETLs are responsible for writing the final report submitted to NATEF 
and may be called upon to verify improvements a school may be required to make to 
meet the standards. 

Since ETLs are familiar with the standards for certification, they may also be asked to 
mentor programs going through certification for the first time. Programs may simply ask 
an ETL for advice organizing documentation required for the on-site evaluation. Others 
may wish more extensive assistance. For the services they provide, ETLs are one 
significant link between programs and the NATEF office. 

To avoid costly travel expenses for programs going through the certification process, 
NATEF makes every attempt to have currently trained ETLs in every state. Under the 
grant, states were able to request ETL training in their states at no additional cost to the 
state. Grant funds paid the travel expenses for the NATEF consultant or staff member to 
conduct the training session. ETL training was also offered at the following national 
conferences: American Vocational Association (AVA), Vocational Industrial Clubs of 
America (VICA), and North American Council of Automotive Teachers (NACAT). Over 
the grant period, 33 ETL training sessions were requested by 25 different states and 13 
were held at national conferences, for a total number of 46 ETL training sessions. Three 
additional states that hosted a national conference elected to use the conference for their 
ETL training needs rather than hosting a separate training session. In all, ETL training 
took place in 28 states. 

Objective Four - Promotion of ASE Standards 

NATEF used numerous methods to promote the use of the standards for ASE certification 
of automotive training programs. At least 102 presentations were made by the project 
director and the NATEF consultants at conferences and meetings, 33 of them at national 
conferences. The presentation topic varied from general information about NATEF and 
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ASE to specific information about ASE program certification, skill standards, or applied 
academics, for example. Not included in the tally are the countless times that NATEF 
information was part of a presentation made by the ASE staff. 

In order to assist schools and promote certification, NATEF staff and consultants 
developed a workshop, “An Instructor’s Guide to ASE Program Certification”, to be 
presented at state and national conferences. General information was given on NATEF 
and ASE as well as topics such as standards development, barriers and ways to overcome 
the obstacles to certification, the collection and organization of documentation materials, 
and the establishment of a timeline for the self-evaluation. NATEF received positive 
feedback from workshop participants after the sessions. 

NATEF exhibited at 19 state and national conferences during the grant period. Not 
included in the number were the displays with information about NATEF done by others 
(instructors, board members, ASE consultants or staff, etc.) where grant funding was not 
used for travel or other costs associated with the display. 

In addition to presentations and exhibits, NATEF used print media to promote the 
standards. The NATEF NEWS was a quarterly newsletter distributed to schools, state 
Trade & Industrial supervisors, board members, the automotive trade press, and others 
from winter 1994 - summer 1995. The newsletter was suspended when staff were no 
longer available to produce it on a regular schedule. At about that same time, however, 
the ASE Communications staff began a quarterly four-color newsletter called the TECH 
NEWS. Each issue contains articles that relate directly to NATEF. TECH NEWS has a 
circulation of over 500,000. Copies are mailed to all ASE certified technicians (many of 
whom are instructors or advisory committee members in schools), board members, the 
automotive trade press, and others. All ASE certified programs receive at least one copy 
of the TECH NEWS. NATEF was featured on the front page several times, once when 
President Clinton visited the ASE certified programs at Shoreline Community College in 
Seattle, Washington. 

Several brochures were produced with grant funds. A brochure on NATEF evaluation and 
ASE program certification was updated. Three new brochures were developed featuring 
careers as automobile technician, collision repair & refinish technician, and truck 
technician. These brochures were widely distributed throughout the country. 

The Career Tracks video was updated to include collision repair & refinish and truck 
areas. A new series of videos was produced, in part with grant funds. The Career 
Encounters: Automotive Technician® video is documentary in style and features careers 
in automobile, collision repair & refinish, and medium/heavy truck areas. This video, 
produced by Davis-Gray, Inc., is 28.5 minutes long and was on PBS, the Mind Extension 
University, and other classroom satellite broadcasts at least six times over a two year 
period. The grant paid for the development of the video while ASE paid for the 
production of three short versions of the video featuring one career area. In addition, ASE 
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paid for the development of a Presenter’s Guide, packaging, and copying all four versions 
of the video. The package comes complete with a set of the career brochures and 
information on NATEF and ASE. 



NATEF staff have responded via phone, fax, or mail to innumerable inquiries about 
NATEF. The project director and consultants attended the project directors meetings. 
Additionally, the project director spent many hours responding to direct inquiries about 
NATEF and the skills standards grant. The project director met individually with 
representatives from other skill standards grants including: heating and air conditioning, 
metalworking, and the electrical construction workers. The purpose of the meetings was 
to familiarize the other grantees with the ASE certification process for technicians and the 
ASE training program certification through NATEF evaluation of schools. 

Additional promotion was accomplished through articles in various publications 
including, but not limited to, Vocational Education Journal. Automotive Body Repair 
News. The Manifold. Journal of Vocational Education Research, and Autolnc . 

Objective Five - Assisting Schools in Initiating the Self-Studv (Self-Evaluation) 

The “Instructor’s Guide to ASE Program Certification” workshop, previously discussed, 
was developed to assist programs that are new to the certification process. Instructors, 
administrators, and counselors are encouraged to attend as a team. In addition to the 
project director and NATEF consultants, others familiar with the certification process, 
such as ETLs, have given the workshop in their states. This workshop has been 
assimilated into regular dissemination activities . 

Many ETLs and other instructors from ASE certified programs have volunteered time to 
assist schools through the certification process on a one-on-one basis or as a group 
activity. These dedicated individuals believe in the benefits of standards and are willing 
to help others achieve those standards. NATEF recommends that instructors from 
programs undertaking certification for the first time talk to instructors from ASE certified 
programs about the process and ask for suggestions for preparing for certification. 

NATEF staff and consultants have also done site visits of programs, upon request, in 
conjunction with travel within the program’s geographic area. These visits were informal 
in nature and recommendations were made for preparation of the self-evaluation. 

SECTION TWO: SCHEDULE OF ACCOMPLISHMENTS 

When the original application was submitted, the project director had not been hired. 
Consequently, when the project director was hired she reorganized the sequence for some 
of the grant activities. The changes effected the timeline only, not the objectives or scope 
of work. A formal modification of the timeline was submitted to the DoED grant program 
manager and budget manager on October 19, 1993. 
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The following chart is a summary of the dates of completion of the objectives as 
indicated in the application, in the amended timeline, and the actual date of completion. 
In the application, estimated completion dates were given according to calendar months. 
The revised timeline looked at completion dates in terms of first or second funding 
period. At the end of the three year grant period not all funds had been expended, 
therefore, NATEF requested and was granted an 18 month extension of time to spend 
allocated funds for continuation of promotional activities, dissemination of information, 
and training ETLs. No additional grant funds were requested. 




7 



SUMMARY OF MILESTONES FOR NATEF SKILLS STANDARDS GRANT 



OBJECTIVE 




COMPLETION 
DATE ON ' — 
APPLICATION 


COMPLETION 
DATE ON 
REVISED 
TIMELINE | ; i|ii 


DATE : 

:io|||L||i|l|l|| 


Revise automobile 
standards 


7/1/93 


3/31/94 


11/93 


Identify applied 
academic skills - 
automobile 


10/1/93 


3/31/94 


review completed 
2/94; final edit & 
books printed 2/95 


Revise collision 
repair & refinish 
standards 


10/1/93 


3/31/94 


11/93 


Identify applied 
academic skills - 
collision repair & 
refinish 


4/1/94 


9/30/95 


review completed 
7/94; final edit & 
books printed 6/95 


Revise 

medium/heavy truck 
standards 


10/1/94 


review by 3/31/94; 
approve by 9/30/95 


review completed 
12/93; approved 
5/94 


Identify applied 
academic skills - 
medium/heavy truck 


10/1/94 


9/30/95 


review completed 
2/95; final edit & 
books printed 10/95 


Train ETLs 


10/1/94 


ongoing throughout 
grant 


3/31/97 


Promote standards 
in states 


10/1/94 


ongoing throughout 
grant 


3/31/97 


Assist schools to 
initiate self- 
evaluation 


9/30/95 


9/30/95 


3/31/97 


Revise Career 
Tracks video 


10/1/94 


3/31/94 


revised 6/93; 
produced new video 
Career Encounters - 
Automotive 
Technician® 2/96 


Basic skills 
identification for 
Certificate of Basic 
Mastery 


9/30/95 


9/30/95 


10/95 
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As previously stated, all of the objectives stated in the application were accomplished. 

The one objective that took significant additional time was the identification of the 
applied academics skills. The reason this took additional time was the significant depth of 
research that was completed. At the onset of grant activities, a research plan for the 
applied academics research had not been developed. Once NATEF contracted with 
V-TECS, the process became a collaborative effort. Gathering the data was relatively 
simple compared to presenting the results in a meaningful manner for a variety of 
audiences. It is the most extensive research to date on related academic and technical 
skills. Editing the books took a great deal of time, more than either V-TECS or NATEF 
anticipated. Ultimately, NATEF completed the final editing of all three books. 

Another difference between the application and the revised timeline related to two 
objectives. The application gave the completion date for training ETLs and promotion of 
the standards in states as 10/1/94. The project director believed from the onset that the 
date was an error in typing the application and was always intended to be an ongoing 
activity. 

During the extension period, NATEF learned of the Career Encounters video series 
produced by Davis-Gray, Inc. The award winning series typically examined careers 
requiring a baccalaureate degree. However, due to significant interest in skill standards, 
tech prep, and school-to-work issues, Davis-Gray, Inc. was interested in expanding the 
series to include technical careers not requiring a baccalaureate degree. The project 
director received permission to have the Career Encounters - Automotive Technician® 
video produced to disseminate information and promote the career area. The video has 
been a success and it won an award for Excellence and Innovation from the American 
Association of Career Educators (AACE) in April of 1997. 

SECTION THREE: PROJECT PARTICIPANTS 

As previously stated the three committees, charged with the responsibility to review and 
recommend revisions to the automobile, collision repair & refinish, and medium/heavy 
truck standards, represented a broad spectrum of the automotive industry. All of the 
committees’ recommendations for change were reviewed and approved by the NATEF 
Board of Trustees and the ASE Board of Directors. 

Identification of the applied academic skills required a combined undertaking by V-TECS 
and NATEF. V-TECS was selected because of their history in occupational analysis and 
their more recent success working with the Basic/Essential Skills Taxonomy. Dr. Ron 
McCage selected the academic experts used in each area: Ms. Barbara Blasch, 
mathematics; Dr. Chrysandra Spiceland, language arts; and Dr. Trina Boteler, science. 

Dr. Patricia Lundquist, NATEF project director, selected the technical experts, all of 
whom were ASE certified technicians. Every person involved in the project contributed 
si gni ficantly to the final product, namely, The Applied Academics and Workplace Skills 
For Automobile Technicians, The Applied Academics and Workplace Skills For Collision 
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Repair & Refinish Technicians, and The Applied Academics and Workplace Skills For 
Truck Technicians. 

NATEF also entered into a contractual relationship with the National Association of State 
Directors of Vocational-Technical Education Consortium (NASDVTEC). The purpose of 
the contract was to examine the NATEF standards to ensure that there was no bias as to 
race, gender, or physical attributes. Ms. Barbara Border of Educational Leadership 
Consultants did the work on the project. The report from NASDVTEC indicated that 
there was no evidence of bias in the NATEF standards. 

Other examples of the high caliber of individuals who worked with NATEF on the 
project are Mr. Mike Davis and Mr. Gary Gray. The Career Encounters: Automotive 
Technician® video produced by Davis-Gray, Inc. was professionally done under the 
guidelines of the contract with NATEF. The NATEF project director identified the 
locations for filming the video and Mike Davis, producer, selected the individuals to 
interview. As mentioned in section two, the video recently won an award from AACE. 

It would be remiss if this report did not include the NATEF and ASE staff, consultants, 
and board members for their dedication to the project and to the stated missions of both 
organizations. Since this project took existing standards and updated them in addition to 
creating new materials, the contributions made by the staff and consultants from the onset 
were part of their daily activities. The counsel of the board members and the consultants 
proved invaluable throughout the project. 

SECTION FOUR: DISSEMINATION ACTIVITIES 

Dissemination activities must be examined in terms of the promotional activities 
discussed in more detail in Objective Four of Section One. Presentations were made at 
national and state conferences and meetings, exhibits at conferences, videos and 
brochures were produced , and articles were published with the intent of disseminating 
information about the national standards for the automotive industry through NATEF 
evaluation and ASE certification of training programs and technicians. (Refer to Section 
One - Objective Four for information on the number of activities and detailed 
descriptions of the activities.) 

Specific information about changes to the standards, ETL training, promotional activities, 
and applied academics was distributed by memo or letter to the following, as deemed 
appropriate for each news item: state T & I supervisors, State Directors of Vocational- 
Technical Education, ASE certified programs, ETLs, and schools in process of 
certification. 

Dissemination was, and continues to be, an ongoing activity, as information is provided 
daily in response to inquiries via telephone, fax, and mail. The program standards books, 
certification manuals, and ETL manuals have been “packaged” differently as a result of 
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the grant, which made them easier to understand and to distribute. The standards are 
available in a GBC bound book, free of charge to all interested parties. The three applied 
academics books are also GBC bound and are free of charge. All ASE certified programs 
received a copy of the applied academics book, appropriate to their program area, when 
the books were printed. The career brochures were also distributed to all ASE certified 
programs and they continue to be available to all interested parties at no cost. The Career 
Encounters: Automotive Technician® video is sold on a cost recovery basis for $22.95. 

SECTION FIVE: EVALUATION ACTIVITIES 

Formative evaluation, while relatively informal, was instrumental for the success of the 
project. Although no workshop committee was ever identical, the process for the 
selection of participants and the procedures used during the reviews remained constant. 
Workshop participants were selected by ASE and NATEF staff or board members 
because they represented a segment of the automotive industry. Workshops were 
facilitated by ASE technical staff and the NATEF project director and any change 
required group consensus. These processes and procedures have served ASE and NATEF 
well over the years. However, the timeline was modified slightly as discussed in Section 
Two. 

The formative evaluation of the applied academics led the project director and V-TECS 
to modify the plan for editing the published results. The project director completed the 
final edit immediately prior to printing the books. 

Progress on the grant was discussed at the regular meetings of the NATEF Board of 
Trustees and the ASE Board of Directors. The appropriate follow-up to suggestions was 
completed by the NATEF project director or consultants. 

The summative evaluation was conducted by the Center for Employment and Training at 
The Ohio State University, as indicated in the grant application. Dr. Morgan Lewis, 
Principle Investigator, studied the effect of program standards on student learning. The 
ASE certified and noncertified programs in the study were matched for similarity. All 
noncertified programs had requested a copy of the ASE certification manual, but had not 
completed the self-evaluation. The outcome measure of learning used test items from a 
standardized test. Differences in intelligence of students were statistically controlled. In 
addition to testing students, on-site evaluations of all programs in the study were 
conducted in the same manner as for ASE program certification. The Ohio State 
University researchers concluded that “certification improves the learning that takes place 
in an automotive repair program” (p. 10). 1 A full copy of the results dated September 
1995 can be found in the Appendix of this report. 



1 Lewis, Morgan V., & Gill, Lawrence (1995). The Effects of Standards on Learning in Automotive 
Repair Programs, Columbus: The Ohio State University, Center on Education and Training for 
Employment. 
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SECTION SIX: CHANGES TO KEY PERSONNEL 



At the time the application was submitted, a project director had not been hired. Dr. 
Patricia Lundquist was subsequently hired on October 8, 1992 to fill the position. She 
submitted a vitae to Ms. Debra Nolan, DoED project manager at the time, and received 
verbal approval to act in the capacity of project director for NATEF. 

The application also indicated the need for a third NATEF consultant. Mr. Sam Rosen 
served in that capacity for several months. However, at the end of his first contract 
period, Mr. Rosen’s contract was not renewed. 

Dr. Byrl Shoemaker formally retired from providing regular services to NATEF in June 
of 1 996 and Dr. Darrell Parks replaced Dr. Shoemaker as NATEF consultant. 

All other ASE and NATEF personnel named in the application remained in their 
positions for the duration of the grant. 
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FOREWORD 



The Center on Education and Training for Employment of The Ohio State 
University is pleased to submit this third-party, summative evaluation to the 
National Automotive Technicians Education Foundation (NATEF). This 
evaluation compared programs that were certified as meeting the standards 
established by the National Institute of Automotive Service Excellence (ASE) to very 
similar noncertified programs. 

The noncertified programs selected for the comparison group had made the initial 
steps toward obtaining ASE certification, but at the time of the data collection were 
not certified. An indication of how close some of the comparison programs were to 
certification is that one of them became certified only two months after providing 
data as a noncertified program. 

Despite the similarity of the certified and noncertified programs, the test results 
indicate that ASE standards do have a positive influence on the learning that takes 
place in automotive repair training programs. 

The study was designed by Dr. Morgan Lewis, Research Scientist from our Center, in 
cooperation with Dr. Patricia Lundquist, the manager of the NATEF skills standards 
project, and Dr. Byrl Shoemaker, consultant to NATEF. Dr. Lewis selected the 
programs for the study and prepared this report with the assistance of Mr. Weidong 
Wang, who conducted the computer analyses. The data collection for the project, 
including the development of the test of automotive repair, was directed by Mr. 
Lawrence Gill, formerly a Vocational Education Consultant/Testing Specialist with 
the Vocational Instructional Materials Laboratory of our Center. 

On behalf of all those associated with this study, I would like to express our 
appreciation to the administrators, teachers, and students of the eight programs, 
secondary and postsecondary, certified and noncertified, in Florida and 
Pennsylvania who provided the data that made the evaluation possible. Needless 
to say, without their cooperation this study could not have been conducted. 

Ray D. Ryan 
Executive Director 
Center on Education and 
Training for Employment 
College of Education 
The Ohio State University 
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